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ABSTRACT 


In this paper, we investigate a coding scheme for error control in data communication 
systems. The scheme is obtained by cascading two error-correcting codes, called the inner 
and outer codes. The error performance of the scheme is analyzed for a binary symmetric 
channel with bit-error rate e < 1/2. We show that, if the inner and outer codes are chosen 
properly, extremely high reliability can be attained even for a high channel bit-error rate. 
Various specific example schemes with inner codes ranging from high rates to very low 
rates and Reed-Solomon codes as outer codes are considered, and their error probabilities 
are evaluated. They all provide extremely high reliabilit y even for very high bit-error rates, 
say 10 _1 to KT 2 . Several example schemes are being considered bv NASA for satellite 
and spacecraft down-link error control. 
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1. Introduction 


In this paper we present and analyze a coding scheme for error control 
for a binary symmetric channel with bit-error rate e < 1/2. The scheme is 
achieved by cascading two linear block codes, called the inner and outer 
codes. The inner code, denoted C ^ , is a binary (n^k^) code with minimum 
distance d.j. It is designed to correct t 1 or fewer errors and simultaneously 
detect A 1 (A 1 _>. ) or fewer errors where t-j+A.j+1 _< d-j [1-5]. The outer code, 

denoted C 2 , is an (n 2 ,k 2 ) code with symbols from the Galois Field GF(2 1 ) and 
minimum distance d 2 . If each code symbol of the outer code is represented by 
a binary 2-tuple based on a certain basis of GF(2 J '), then the outer code 
becomes an (n 2 2,k 2 2) linear binary code. For the proposed coding scheme, we 
assume that the following conditions hold: 

^1 * ®i 2 , ( 1 ) 

and 

n 2 - m 1 m 2 , (2) 

where m 1 and m 2 are two positive integers. 

The encoding is performed in two stages as shown in Figures 1 and 2. 
First a message of k 2 2 binary information digits is divided into k 2 bytes of 
2 information bits each. Each 2,-bit byte (or binary 2-tuple) is regarded as 
a symbol in GF(2*0. These k 2 bytes are encoded according to the outer code C 2 
to form an n 2 -byte (n 2 2 bits) codeword in C 2 . At the second stage of 
encoding, the n 2 -byte codeword at the output of the outer code encoder is 
divided into m 2 segments of m 1 bytes (or m^ bits) each. Each m^byte segment 
is then encoded according to the inner code C 1 to form an n^bit codeword. 
This n.j-bit codeword in C 1 is called a frame . Thus, corresponding to a 
message of k 2 2 bits at the input of the outer code encoder, the output of the 
inner code encoder is a sequence of m 2 frames of n 1 bits each. This sequence 
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of m 2 frames is called a block . The entire encoding operation results in a 
binary (m 2 n-| ,k 2 !D linear code C which is called a cascaded code . If m 1 = 1 
(i.e., each segment consists of a single d-bit byte), the cascaded code C 
becomes a concatenated code [6], A concatenated code with varying binary 
linear block inner code can be regarded as a cascaded code with n 2 = m-| and 
m 2 *1. Therefore there exist cascaded codes which asymptotically meet the 
Varshamov-Gilbert bound for all rates [7]. 

The decoding for the proposed scheme also consists of two stages as 
shown in Figures 1 and 3* The first stage is the inner code decoding. 
Depending on the number of errors in a received frame, the inner code decoder 
performs one of the three following operations: error-correction , erasure and 
leave-it-alone (LIA) operations. When a frame in a block is received, its 
syndrome is computed based on the inner code C^. If the syndrome corresponds 
to an error pattern i of or fewer errors, error correction is performed by 
adding e to the received frame. The n 1 -k 1 parity bits are removed from the 
decoded frame, and the decoded m-j-byte segment is stored in a receiver buffer 
for the second stage of decoding. A successfully decoded segment is called a 
decoded segment with no mark. Note that a decoded segment is error-free , if 
the number of transmission errors in a received frame is t 1 or less. If the 
number of transmission errors in a received frame is more than A-j, the errors 
may result in a syndrome which corresponds to a correctable error pattern 
with t 1 or fewer errors. In this case, the decoding will be successful, but 
the decoded frame (or segment) contains undetected errors. If an 
uncorrectable error pattern is detected in a received frame, the inner code 
decoder will perform one of the following two operations (See section 2.2): 

1. Erasure Operation — The erroneous segment is erased. We will call 
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such a segment an erased segment. Note that this operation creates 


m 1 symbol erasures. 

2. Leave-it-alone (LIA) Operation — The erroneous segment is stored in 
the receiver buffer with a mark . Note that a marked segment may 
contain error-free symbols. 

Whether the erasure operation or the LIA-operation is performed depends on 
the degree of error contamination in the erroneous segment. Since the outer 
code C 2 has a fixed minimum distance, it is desired to devise a strategy to 
choose between these two operations so that the minimum distance of the outer 
code is used most effectively in correcting symbol erasures and errors. A 
simple strategy may by devised based on the concepts of correcting symbol 
erasures and errors [2-5]. For a code to be able to correct e or fewer symbol 
erasures and t or fewer symbol errors, its minimum distance d is at least 
e + 2t + 1. This implies that, to correct one symbol erasure, one unit of the 
minimum distance of the code is needed. However, to correct a symbol error, 
two units of the minimum distance of the code are needed. In the proposed 
scheme, when an erasure operation is performed, m 1 symbol erasures are 
created. To correct these m 1 symbol erasures, m 1 units of the minimum 
distance of the outer code are needed. When a LIA-operation is performed, the 
marked segment contains one to m 1 symbol errors. As a result, 2 to 2m 1 units 
of the minimum distance of the outer code are required to correct these 
symbol errors. It is clear that, to minimize the consumption of minimum 
distance of the outer code, we would perform the LIA-operation when the 
number of symbol errors in an erroneous segment is less than [m.j/2j+1, and 
perform the erasure operation when the number of symbol errors in an 
erroneous segment is greater than [m^/2j. Hence we may use the following 
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strategy to choose between the erasure operation and the LIA-operation: If 
the probability that an erroneous segment contains more than \m^/2j symbol 
errors is relatively small compared to the probability that the erroneous 
segment contains |jn i / 2 J or less symbol errors, the LIA-operation is 
performed. Otherwise, the erasure operation is performed. The joint 
probability distribution that a received frame is decoded successfully (or 
detected to contain an uncorrectable error pattern) and the corresponding 
segment contains w symbol errors is derived in Section 2.1 (or 2.2). 

The inner code decoding described above consists of three operations: the 
error correction, the erasure and the LIA operations. An inner code decoding 
which performs only the error-correction and erasure operations is called an 
erasure-only inner decoding. On the other hand, an inner code decoding which 
performs only the error-correction and LIA operations is called a LIA- 
only inner decoding. In this paper we mainly consider the erasure-only inner 
decoding and the LIA-only inner decoding. Which of these two decodings gives 
better performance will be discussed in Section 2.2. A combined erasure-and- 
LIA inner decoding is discussed in Section 5. 

As soon as m 2 frames in a received block have been processed, the second 
stage of decoding begins and the outer code decoder starts to decode the m 2 
segments which are stored in the buffer. Symbol errors are contained in the 
segments with or without marks. Each erased segment results in m 1 symbol 
erasures. The outer code C 2 and its decoder are designed to correct the 
combinations of symbol erasures and symbol errors. Maximum-distance-separable 
codes with symbol from GF(2®') are most effective in correcting symbol 
erasures and errors. 

Now we describe outer code decoding process. Let i and h be the numbers 
of erased segments and marked segments respectively. The outer code decoder 
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declares an erasure (or raises a flag ) for the entire block of m 2 segments if 
either of the following two events occurs: 

(i) The number i is greater than a certain pre-designed threshold 
T es with T es 1 ( d 2' 1)/m l • 

(ii) The number h is greater than a certain pre-designed threshold 
T e £(i) with T e ^(i) <_ (d 2 *1-m 1 i)/2 for a given i. 

If none of the above two events occurs, the outer code decoder starts the 
error-correction operation on the m 2 decoded segments. The m 1 i symbol 
erasures and the symbol errors in the marked or unmarked segments are 
corrected based on the outer code C 2 . Let 1 2 ( i ) be the error-correction 
threshold for a given i where 

T et (i) 1 t 2 (i) £ (d 2 -1-mii) / 2 . (3) 

If the syndrome of m 2 decoded segments in the buffer corresponds to an error 
pattern of m^ erasures and t 2 (i) or fewer symbol errors, error-correction is 
performed. The values of the erased symbols, and the values and the locations 
of symbol errors are determined based on a certain algorithm. If more than 
t 2 (i) symbol errors are detected, then the outer code decoder again declares 
an erasure (or raises a flag) for the entire block of m 2 decoded segments. 

When a received block is detected in errors and can not be successfully 
decoded, the block is erased from the receiver buffer and a retransmission 
for that block is requested. However, if retransmission is either not 
possible or not practical and no block is allowed to be discarded, then the 
erroneous block with all the parity symbols removed is accepted by the user 
with alarm. An important feature of the proposed scheme is that the decoding 
information of the inner code decoder is passed to the outer code decoder. 
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This makes the outer code decoding more efficient. 

In the rest of this paper, the error performance of the proposed 
cascaded coding scheme is analyzed. Interleaving the outer code is 
considered. We show that, if the inner and outer codes are chosen properly, 
extremely high reliability can be attained even for high bit-error rate, say 
e=10 - ^. Various specific example schemes with inner codes ranging from high 
rates to very low rates and Reed-Solomon codes as outer codes are considered, 
and their error probabilities are evaluated. They all provide extremely high 
reliability. Several of these specific schemes are being considered by NASA- 
GSFC for satellite and spacecraft down-link error control [8], 


2. Probabilities of Correct Decoding, Incorrect Decoding and Decoding 
Failure for a Frame 

In this section, we analyze the inner code decoding. We assume that 
the channel is a binary symmetric channel with bit-error rate e <_ 1/2. Let 
P^, 1 ^ be the probability that a decoded segment is error-free. A decoded 
segment is error-free if and only if the corresponding received frame 
contains t^ or fewer errors. Thus 


p(1) 


Z 

i-0 


n. 


(«') eMl -e) 


< n-i-i 

1 1-c' 1 


(4) 


Let be the probability of an incorrect decoding for a frame. This 

is actually the probability of an error pattern of X.+1 or more errors whose 
syndrome corresponds to a correctable error pattern of t 1 or fewer errors. 
Let p£^ be the probability of a frame erasure, and let P^ be the 
probability that a LIA operation is performed on a frame. Let Pgp^ be the 
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probability that a decoded segment with or without a mark contains errors. 


Then 


and 


p C 1 ) + p(1) + p(1) + p(1) m i 

*c *ic r es ^ei, * 


P (1 ) _ P (1) + P (1) 
*er *ic ^ei * 


(5) 

(6) 


Note that P^ 1 ^ + P^^ is the probability that a received frame is decoded 
successfully (correctly or incorrectly), and + P^ represents the 
probability of a decoding failure . 

Let and be the numbers of codewords of weight i in the inner 
code Ci and its dual code respectively. Let W^g(n) denote the number of 
binary n-tuples with weight j which are at a Hamming distance s from a given 
binary n-tuple with weight i. The generating function for W^ s (n) [9] is 


Z Z wS i i(n)xJy 3 - ( 1 +XY ) n_i (X+Y ) 1 . (7) 

j-0 s=0 J ’ s 


It was proved by MacWilliams [9] that 


O) + p0> - e 1 a{ 1} Z 1 I 1 wj i hn 1 )eJ(1-e) n l' J , 
c 1C i-0 1 j-0 s«0 J,s 1 


— v> n i 
r i J p(D 


2 1 Z (1-2E) 1 P t ( i-1 ,n, -1 ) , 

i-0 1 H 1 


( 8 ) 

(9) 


where r^-n^-k^ is the number of parity-check bits of the inner code, and 
P s (*,*) is a Krawtchouk polynomial [4,p.129] whose generating function is 

Z P„(i,n)Y s - ( 1 +Y) n-i ( 1 -Y) 1 . (10) 

s-0 3 
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Equations (8) and (9) are useful for computing + P^ if a formula for 

or is known, or min(k 1 ,r-| ) is small enough (say less than 30) to be 

feasible to compute or by generating all the codewords in or C^. 

Hereafter, .we mainly consider the LIA-only inner decoding and the 
erasure-only inner decoding (A combined inner decoding is discussed in 
section 5). For the LIA-only inner decoding, the LIA-operation is performed 
whenever an uncorrectable error pattern in the received frame is detected. In 
this case, the frame erasure probability P^^ is "zero". For the erasure-only 
inner decoding, it is obvious that P^p - 0. 

If P^p (or Pggb is known, then P^ (or P^) and P^ can be computed 
from (4) to (6) and (8) (or (9)). 

2.1. Detail Error Probabilities for a Decoded Segment with no Mark 

A successfully decoded segment may contain errors. For 0 _< w _< m., , let 
pj^ be the joint probability that a segment is successfully decoded and the 
number of symbol (or byte) errors in the decoded segment is w. It is clear 
that 


and 



P 


0 ) 

e,0 


m i 

P (1) „ * P (1) 
ic P e,w * 


( 11 ) 


To obtain the probability of a correct block decoding, we need to know piV, 
for 0 < w < m.. In this section we will derive a formula for pj\] . 

For a binary n 1 -tuple v, we divide the first k^-m^ bits into m 1 £-bit 
bytes. For 1 £h <_ m 1 , let i h be the weight of the h-th 51 — bit byte of v. Let 
i m ^ + 1 be the weight of the last r^=n^-k^ bits. Then the (m^ +1 )-tuple, (i^, 
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i 2 , •••» i m ^ + i), is called the weight structure of v. 

Suppose that a frame u is transmitted and an error pattern 5 with weight 
structure (j 1 , j 2 , •••, j m ^ + i) occurs. The probability of occurrence of e is 


P(i) 


n m i + 1 i 

(1-e) 1 n ( £ /(1-e)) Jh 
h=1 


( 12 ) 


Suppose that there is a codeword v in Ci which is at a distance t^ or less 
from e. Since the minimum distance of C.j is assumed to be greater than 2t 1 , 
such a codeword v in is uniquely determined. Then the inner decoder 
assumes that the frame u+v was sent, and the error pattern i+v occured. The 
decoded segment is the first k^-bit of u+v. If v is a nonzero codeword, the 
decoding is incorrect, and the first k.,-bit of v represent the errors 
introduced by the inner code decoder. If there is no such codeword v in C 1 , 
then the inner code decoder performs either the LIA-operation or the erasure- 
operation. Conversely, for a codeword v in C-| whose weight structure is 
(*1 »i 2 . * * •» i m 1 +1^' there are 


m 


1 (in) 


^ *m, + 1 ^ 


[ n W, h s OO] • W i 1 (r 1 ) 

h-i J h» s h Jm^l'^+I 1 


(13) 


error patterns e's with weight structure (j 1f j 2 » ••*, j m ^ + i) such that the 

weight structure of v+i is (s, , So, ••*, s_ .,). LetAp^ .. , be the 

i ^ m 1 +1 1 1* 1 2» » 1 m 1 +1 

number of codewords in C 1 with weight structure (i-,, i 2 , i m For 0 £ 

w £ mi , let 

x w m {(i 1» h’ : 0 £ i h £ A for 1 £ h £ m 1f 0 £ i^ +1 £ r, , 

and exactly w components of (i.j, i 2 , •••, i m ^ ) are nonzero.} . 

(14) 

Then, pJJJ is given below: 


- 1 0 - 


P 1 1 A = Z Ap ) 


e,w 


where 


U, , 


i 2'--» i m 1+ 1 )eI w i 1’ i 2’ , ‘*’ i m 1 +1 J^O* * 'j^-0 j mi + 1 =0 


1 U h > 


, (im 1 +l) 


r i , - uii i 

, 1 , [ n w i » U)] • w i 1 

(s 1 ,S 2 , •• • ,s m +1 )eS t h«=1 J h’ h J m 1 +1* s m 1 + 


(r,) 


n, r m 1 


(1-e)" 1 [ n'(e/(1-e)) Jh ] , 
h-1 


( 15 ) 


S ti = { (s 1 , s 2 , s mi + 1 ) : 0 £ s h £ l, for 1 £ h £ m 1 , 0 £ s rai+1 £ 


+1 

and Z 3 h < t-i } . 

h=1 h — i 


( 16 ) 


The formula given by (15) is useful if either (1) the dimension of , is 

small enough (say k 1 < 30) to be feasible to compute the detail weight 

distribution, {aPP ... , }, by generating all the codewords in 

x ‘\ ,1 2’ » 1 m 1 +1 

C-| , or (2) the dimension of cj" , r^, is small enough to be feasible to 
compute the detail weight distribution of and the number of element in I w 
is small enough to be feasible to enumerate all the elements in I w and 
compute i 2f . . . } by using the generalized MacWilliams' Identity 

[4]. 1 

Next we will express the probability in terms of the detail weight 

distribution of the dual code C^" of C^. Let H be a subset of { 1 ,2, • • • ,m.j } . 
Let P^^(H) be the probability that for heH, the h-th Jl-bit byte of a decoded 

segment is error-free. Let H be the complement of H in { 1 ,2, • • • ,m.| +1 }. Define 

the following set: 

1(H) ■ { ( i 1 , i 2 , • • • , i m +i ) : i h ■ 0 for heH, 0 £ i h £ Jt for heH-{m.j+1 } , 


and 0 < im 1+ l 1 


(17) 


Then, we have that 
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P,P } (H) 


A 


( 1 ) 


( i 1 ,i 2 ,.--,im i+ i)e I (H) 1 1* 1 2' ,,, * 1 m 1 +1 Jj-0 J^-Oj^-O 

m 1 ( i h ) . . ^ i m 1 +1 ) 


• e , [n wP h 'u)] • w, ' 

(Si fS 2 , •••.s t n i+ i )es t h-1 J h* s h J m.,+1’ 


mi 


(1-e)" 1 [ n'(e/(1-e)) Jh ] , 

h-1 ■ 


s (r 1 } 

s m.,+1 1 


(18) 


Define 


Q s (i,n,m,Y) = ! q Y-j (J) P s _j(i,n) 


(19) 


Q t (i,n,m,Y) = E Q (i,n,m,Y) . 


s=0 


( 20 ) 


It follows from (10) and (19) that 


( 1 +YY) m ( 1 +Y ) n 1 ( 1 -Y ) ^ » E Q ( i ,n,m, Y) Y 3 . 

s=0 3 


( 21 ) 


Let Bp* 


’ ’ +1 


be the number of codewords in Cp 


Then we have Lemma 1 • 


with weight structure 


Lemma 1 : 


Pp } (H) - 2~ Pl % 


1 E ••• E E Bp) . [ n (1-2e) lh l 

*1“° 1f 2> ’ m 1+ 1 l heH 

£| H | 

• (1-e) • 5 t ( E_i h , n r £|H|, 8. | H | , e/(1-e)) , (22) 


where | H | denotes the number of elements in H. 
Proof ; See Appendix A. 
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For 0 <_ s <_ nip let U s be the sum of '(H) where H is taken over all the 


subsets of {1 ,2, • • • .m. } with s elements. Define 


I H | - 3 


Q t ( Z i h , r^-is, Is, e/( 1 -e ) ) . (23) 

1 heH 


Then it follows from (22) and (23) that 


-r, l l l ‘1 

2 1 Z Z ••• Z Z 

i 1 = 0 i 2 =0 i m 1 =0 ^+1" 0 


B i i ... i W 1 ?’ 

1 1 ,1 2* ^m^ + l s 1 d 


• ^■m 1 +1 * e ^ 


In the sum U s , error patterns with m^s-1 or less symbol (or byte) errors in 
a decoded segment are counted more than once. In fact, 


fj = p(1) + (s+1 ) p(1) +(3+21 p(1) + ... + ( m 1 1 p(1) 

u s *e,m.,-s *• 1 > ^e.m^s-l 2 ' p e,m.|-s-2 '•n^-s-' p e,0 


Using the principle of inclusion and exclusion [10], we have that 


P ( 1) » i ( _i)h r m 1 J +h ) n 

e ’j h-0 J 1 h >\‘3+h ‘ 


For 0 <_ j <_ m 1 , define 


j v, ,mi-i +h. 

Tj(ii ,i 2 , ••*,im i+ i ;e) - ^ -j+h^ i 1 • i 2’ * * * * i m 1 +1 ;e ^ * 


Then it follows from (24) to (27) that we have 
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Theorem 1 : 


> 0 ) _ 
e.j 


Ti 1 

2 1 E 


l 

Z 


i.,=0 i 2 =0 


Z 

z 


1 


E 

V 01 m 1 + 1-° 2< 


*.im 1+ 1 T j (l 1 ,1 2'***» 1 m 1 +1 ;e) 

(28) 


AA 


It is feasible to obtain detail weight distribution {Bp\. 

by generating all the codewords in for relatively small r.|, say less than 

30. Note that the number of terms to be added in the right-hand side of (23) 
/ m . . 

is ( J , and therefore the number of terms to be added or subtracted in the 
right-hand side of (27) is at most 2 . For small m^, Tj(i 1 , i 2 , • • • ,i m +1 ;e) 

can be easily computed and added for each codeword generated. If the dual 
code of Ci contains the all-one vector, then Pg'j can be computed by 
generating every codeword in the even-weight subcode and using 


} 


T j ( i 1 » 1 2 * 


instead of Tj(i 


“*» i m 1+ r* e) + T j U-i 1 .£- i 2.**** r i-im 1+ 1 
! ,i 2 ,’**,i n , i+ i ;e). From (11) and (28), P 


;e) 

( 1 ) 

ic 


can be computed. 


2.2. Detailed Error Probability for a Marked Segment 

In this section we will evaluate the probability of symbol errors in a 
marked segment. Let P@j^ w be the joint probability that a segment is marked 
and the number of erroneous symbols in the marked segment is w. Then 



m 1 

E 

w-1 


(1 

eZ,w * 


(29) 
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In the following, we consider the LlA-only inner decoding. Define 


J w = {( Jl ) : 0 1 Jh 1 1 for 1 1 h 1 m 1 » 0 1 J m +i 1 r 1 » 

and there are exactly w nonzero components in ( !•) , j 2 » * * * * J m ) } 


Then it follows from the definition of Fg^ w that 


P (1) 

ei,,w 


, , „ k. -iw SL l 

L ) Cl-(1-e) A ] w (1-e) 1 - Z ••• Z 


m. 




A (1) 

A i 


1 Uh) 


1} i ... i Z Z [ n' Wj^gUJe^d-e ) 1 Jh ] 

V x 2 f » 1 m 1 +1 J w S t h=1 J h’ s h 

^m.+l^ Jm,+1 r 1~Jm 1 +1 

• W, 1 (r, )e 1 (1-e) 1 

J m 1 +1* s m 1 +1 1 


(30) 


(3D 


where is defined by (16). The first term of (31) represents the 

probability that there are exactly w erroneous symbols (or bytes) in the 
first m 1 bytes of a received frame, and the second term is the probability 
that the syndrome of these symbol errors corresponds to an error pattern of 
t 1 or fewer errors. Define 

R w (i lf i 2 ,-..,i ;e) = Z n {(1-2e) ih -(l-e) 1 }, (32) 

w 1 * ra 1 H£{1 ,2,***,m 1 } heH 

I H | * w 


where the summation is taken over all the subsets of { 1 ,2, • • • ,m.| } with 
exactly w elements. Then can be expressed in terms of the detail weight 
distribution of the dual code of Cp 


'heorem 2: 


P U!w = (1-e) kl ’ £W t 0) [1-(1-e)*] w 


Ti i 
- 2 1 E 


••• 2 I “i’Y ••• 1 <'-2e) 

0 v° V 1 ' 0 1 2 ' 


m 1 +1 


m.| +1 

E_ ih~1 » ^ * ^2* * * * ’ ^ ^ ) * 


'1 h=0 


mi 


(33) 


Proof: See Appendix B. 


AA 


An important question is which provides better performance, "the LIA- 
only inner decoding," or "the erasure-only inner decoding ?" LIA-only inner 
decoding may be reasonable only if 


If 


w= 


ra l 

E 

[m 1 /2j +1 


P (1) 

e!l,w 


< 


P (1) 
*es * 


m. 


w=|m 1 /2j + 1 


P (1) 

F el,w 


« 1- P 


( 1 ) 


P (1) 

*ic 


where pj^ w is computed under the assumption that the inner code decoding is 
a LIA-only inner decoding, then a LIA-only inner decoding provides better 
performance than the erasure-only inner decoding. 


3. The Probability of a Correct Block Decoding 

In this section, we will evaluate the probability that a block of m 2 
segments will be decoded correctly by the outer code decoder. Let P e (j,m,h) 
denote the probability that there are h segments with marks and j symbol 
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errors in a set of consisting of m decoded segments with or without marks. It 
follows from the definition of P e (j,m,h) that 


P e (j 

,1.0) 

_ P (1) 

‘ P e,j • 

for 

° i j i m i » 

(34) 

P e (j 

,1,1) 

. P (1) 

' P eit,j ’ 

for 

0 <_ j <_ m 1 , 

(35) 

P e (j 

,1,0) 

- P e ( j ,1,1) - 0 , 

for 

j > nii , 

(36) 



min( j ,m 1 ) 

/ M \ 

/ A \ 


P e (j 

,m,h) 

- I P (j-w,m-1,h) 

w=0 e 

p e,w + * 

(37) 


From (34) to (37), P e (j,m,h) can be computed readily. 

The probability that, after the inner code decoding of a block of 
frames, there exist i erased segments, h marked segments and j symbol errors 
in the marked and unmarked (or decoded) segments is 

(” 2 ) [P^] 1 P e (j,m 2 -i,h) . (38) 

Therefore, the probability of correct decoding of a block, denoted P c , is 
given by 

P c - I (, 2 ) [P^/] 1 l l P e (j,m 2 -i,h) . (39) 

c i-0 1 es h**0 j=0 e d 

Let P es and P gr denote the probabilities of a block erasure and an 
incorrect decoding respectively. Then 

p c * p es * p er ‘ 1 • < 40 > 

It follows from definitions that the following equality and bound hold: 
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p + p 
es r er 


es m- 


1-0 1 es h-0 J-t,(i)+1 e 2 


T eJl (i) n 2 _ m 1 i 


h) 


m 2 -i 


© 




m* 


i=T es +1 


m- 


U c ) CpIP ] 1 (i-pIP) 2 


m 0 -i 


es 


es 


( 41 ) 


er 


T es m 2 i n 2 m 1 1 

< E (« z ) [PiP] 1 E E , P e (j,m 2 -i,h) . 

~ i-0 1 es h-0 j-d 2 -m 1 i-t 2 ( i ) e 2 


(42) 


The right-hand side of Eq.(4l) provides an upper bound on the probability of 
a block erasure (or decoding failure), and the right-hand side of (42) gives 
an upper bound on the probability of an incorrect block decoding. 

To the authors' knowledge, no feasible procedure for computing P ep or 
P es has been derived except for the special case where the outer code is a 
binary code (£-1) and used only for error detection and n 1 -k 1 +n 2 ~k 2 is small, 
say less than 25 [11]. If the outer code is used for both error correction 
and detection, detailed information on the weight distribution of outer 
codewords with specified bit patterns is required in general. 


4. Interleaving 

In this section, we investigate how interleaving affects the error 
performance of the cascaded scheme. Suppose that the outer code C 2 is 
interleaved in such a way that each symbol (or i-bit byte) in a segment is 
from a different outer code codeword as shown in Figure 4. Hence the 
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interleaving depth (or degree) is Each symbol-column (an n 2 x *. submatrix) 

in the first m 1 columns of the code array is called a section . Note that a 
section is simply a codeword in the outer code C 2 . The k 1 k 2 bits in the first 
k 2 rows and k^ columns are used as information bits. The code array consists 
of n 2 frames and is transmitted row by row. As for the decoding, after n 2 
received frames have been decoded by the inner code decoder, the n 2 decoded 
segments are arranged into an array as shown in Figure 5 which is called a 
decoded segment-array. Note that an erased segment creates one symbol erasure 
in each section. A decoded segment with or without mark may contain symbol 
errors which are distributed among the m^ sections of a decoded segment- 
array, at most one symbol error in each section. Therefore, each section in a 
decoded segment-array may contain symbol erasures and errors. Now each 
section is decoded based on the outer code C 2 . Note that buffers are needed 
to store code arrays at both transmitter and receiver. 

For 1 £ u £ m 1 , let P e (u) be the probability that the u-th symbol of a 
decoded segment with no mark is erroneous. If the inner code is quasi- 
cyclic by every s-bit shift where s divides %, then P e (u) is independent of 
u. It follows from the definition that 

P e (u) = p£ 1} + P^ } - p£ 1} ({u}) , (M3) 

where Pg^({u}) is given by (18) or (22). Hence P e (u) can be computed from 
either (8) and (18) or (9) and (22). 

Let P e j i (u) be the probability that the u-th symbol of a marked segment 
is erroneous. For simplicity, the LIA-only inner decoding is considered. 
Define 

<Ku) = { (j 1 ) : 0 £ j h £ «, for 1 <_ h <_ m 1 , j u *0 

and 0 £ J m ^ £ r 1 } . (MM) 

Modifying the derivation of (31) or (33). we have that 
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~ k> 3C 

P e X,(u) “ 1 “ ( 1 _ e)*' - I ••♦.Z 


h-° V° \ + r° 1 1 ’ 1 2’ * * * * 1 m 1 +1 

Z Z [ I 1 Wj lh ga)e Jh (1-e) a Jh ] 

J(u) S*. h=1 J h’ s h 

z -\ 

^m.+l) Jra n +1 r 1~Jm 1 +1 

W 1 1 s (r,)e 1 (1-e) 1 

J m 1 +1* s m 1 +1 1 


— n I®' S' 1 fi\ 

P s o(u) - 1 - d-E) 1 - 2 Z ••• E I BS'\ ... , 

e * 1,-0 l B) -0 i^.,-0 1’ 2’ -Vi 

+1 j m^l 

• n (1-2e) h [1-(1-e)*(1-2e) u ] P t ( Z i h -1 , n.-l) . 
h=0 Zl l h=0 n 1 


[See Appendix C for the derivation of (46)]. 

Since the outer code is interleaved by a depth of , the u-th symbol of 
every segment is from the u-th section for 1 <_ u <_ m 1 . Let P c (u), P es (u) and 
P er (u) denote the probabilities of a correct decoding, an erasure and an 
incorrect decoding for the u-th section respectively. Then formulas or bounds 
for P c (u), Pg 3 (u) and P er (u) can be derived from those for P c , P es and P ep by 
the following replacement: m^i -*• i , m 2 ■* ^ and 


n 5 -i n 5 -i-h h 

l E P e (J.m 2 -l.h) - I ( 2 h ) E ( s )(j5 s ) 


• cp e (u): 3 [i-pU ) -p<J , -; e (u)] n2 ' 1 * h ' 3 


[; e .(u)]j- s [p<{>- ; ei (u)3 h - ( j 


-( j-s) 


- 20 - 


The restrictions on thresholds T es , T ^(i) and t 2 (i) can be relaxed as 
follows : 


T es — d 2 _1 ’ T e j_(i) <. (d 2 -1-i)/2 and t 2 ( i) <. (d 2 -1 -i )/2 . 

Let P c be the probability of a correct decoding for all interleaved m 1 

sections. Let P__ and P_ c be the probability that an incorrect decoding 
sr “o 

occurs for at least one of the interleaved m 1 sections and that of a block 
erasure, respectively. Then 

P < max m.P (u) , (47) 

~ 1 l u l m l 


and 

1 - ? n - P pr + Pp S < max m,(P (u) + P (u)) . (48) 

c er es — i <u< l er es 


Let P er + P es denote the right-hand side of (48). 

Next we present a formula for P c and another upper bound on P er . For 
simplicity, we only consider the erasure-only inner decoding in which t 2 (i) 
is independent of i and is denoted t 2 . 


For a binary m 1 -tuple (a 1 , a 2 , • • • , a m ^ ), let . ,a denote 


the 


probability that a segment is not erased and the u-th symbol of the decoding 
segment is error-free if and only if a u =0 in the inner code decoding. A 
computing procedure for piV . .. _ is shown in Appendix D. For a positive 


m 


integer n and integers with 1 <_ h £ m^ such that 0 <_ £ n, let 

P p a a ... < (n) be defined by 

e >J 1 »J2* *Jm 1 

a„ 


> 0 ) 
e f 9 a 


ai a- 


m 1 ..n 

*l'V — O 


Ui4 

(a 1 ,a 2 , • )e{ 0 , 1 } 

n n n Ji j? ^ m i 

Z Z ••• Z P e 4 * ... * (n) X/X 2 2 ***X 1 

J-,-0 j 2 *0 J m -0 e,J 1’ J 2’ » J m 1 1 2 m 1 


( 49 ) 


Then P Q (- 1-P er -P es ) is 8 iven by 
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(50) 



® f J 'i f J 2 * 


J m. 


(n 2 -i) 


It is feasible to compute P c for small m 1 , t 2 and relatively small min{k 1 , 
n-j -k.| } . 

For 1 <_ u <_ m.j and a in GF^), let p e (u,a) be the probability that a 
segment is not erased and the u-th error symbol of the decoded segment is a. 
A procedure for computing p e (u,a) is stated in Appendix E. Then we have that 


P e (u) = l p e (u, a) . 

aeGF(2^)-{0} 


(51) 


In Appendix F, the following upper bound on P er is derived. 


es ,n. 


n 2 -i , no -i, niin{t 2 ,n 2 -i-w} 


... .. tr> 

~2 


f n 2 -i-w, w 


m. 


( 1*0 ± n y n /.,« i _ 

2 h ) . Z (j ) E P(u, i,w,h, j ) , 

1 j*w+h-t 0 J u-1 


where 


P(u,i,w,h,j) - [PpP] [p p (u)3 


i - i+w+h-d 


es J 


2 [p e (u,0)] 2 


n-,-i-w-h 


(52) 


/•,\ w-j 2^-2 _ j+do-i-w 

• [i-P Hh z Cp 6 (u ,y^)T 2 


Q“0 


(53) 


where Y is a primitive element of GF(2 i ). 

Let P er be defined as follows: 

(1) For the case where the outer code is not interleaved, P er denotes the 
right-hand side of (42), and 

(2) for the case where the outer code is interleaved by a depth m^ , P er 
denotes the right-hand side of (47), if an erasure-only inner decoding 


- 22 - 


is used and t 2 (i) is independent of i, and otherwise, P ep denotes the 
right-hand side of (52). 

It follows from ( -42) , (47) and (52) that 

p er — p er * 

For most cases of the example schemes considered in the next section, the 
right-hand side of (52) is considerably tighter than that of (47). 


5. Example Schemes 

In the following we consider various specific example schemes using 
cascaded coding for error control. In these example schemes, the inner codes 
range from high rates to very low rates, and the outer codes are Reed-Solomon 
(RS) (or a shortened RS) codes with symbols from GF(2^). The outer code is 
either interleaved or not interleaved. The inner codes with their parameters 
and generator polynomials are listed in descending order of the rates in 
Table 1. The first three inner code, C-,(1) to C.,(3) are shortened distance-4 
Hamming codes. The next three codes, C.,(4) to C.j(6) are obtained by 
shortening the even subcodes of primitive BCH codes of length 63. The forth 
and fifth codes, C^(4) and C i ( 5 ) , can be decoded with a table look-up 
decoding. The sixth code C-|(6) is majority-logic decodable in two steps [1], 
and its decoder can be implemented easily. C^(7) is a quadruple-error 
correcting Goppa code [12], The eighth code is an extended primitive BCH 
code. In fact, is is also a Reed-Muller code and is majority-logic decodable. 
C-|(9) is the extended (24,12) Golay code which is widely used for satellite 
and deep space communications. C^(10), C -j (12) and C 1 (1 3 ) are low-rate 
biorthgonal codes (or first-order Reed-Muller codes). (11) is a quadruple- 
error correcting one-step majority-logic decodable code [1]. 
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For various combinations of code parameters and bit-error rates, the sum 
of the probability of a block erasure (decoding failure) and that of a 
decoding error, P es + P er [given by (41) or (50)], and upper bound P er [defined 
in the previous section] on the probability of a decoding error are given in 
Tables 2 to 5 and Figures 6 and 7. The degree of interleaving, denoted I d , is 
either 1 or m^ Thresholds, T e4 and t 2 » which are independent of the number 
of erased segments are considered here. The parameter, m., T es /I d +2t 2 +1 , is 
used as a measure of the complexity of the outer code. 

Symbol "E" (or "L") shown in Tables 2 to 5 indicates that an erasure- 
only inner decoding (or a LIA-only inner decoding) is used. For a comparison, 
we also consider a combined erasure and LIA inner decoding where the LIA- 
operation is performed whenever an uncorrectable error pattern whose weight 
is even (or odd) is detected in a received frame for odd (or even) t-j. In 
Table 2 symbol "E-L" indicates that the combined inner decoding is used. For 
the combined inner decoding, formulas for P^, Pgj. 1 ^ and P e j > (u) are given 
in our NASA Technical Report [8]. In Table 2, the computation results for the 
combined inner decoding are given only for the cases where either d 2 or 
m 1 T es /I d +2t 2 +1 is smaller than that for either the erasure-only inner 
decoding or the LIA-only inner decoding. 

Example schemes shown in Table 2 are obtained as follows: Given the 
inner code C i ( i ) with 1 £ i <_ 7, n 2 »252 or 255, I d -1 or m 1 and the type of 
inner code decoding, the values of t 2 , T es and T ei are chosen to minimize 
m 1 T es /I d +2t 2 +1 under the condition that 

P es + p er ^ or P es +P er^ < 10 

for bit-error rate e - 10 -2 , and then the minimum value of d 2 is chosen to 
satisfy the following condition 

hr < 10- 10 
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for e = 10' 2 . Only the example schemes with rates greater than 0.6 and d 2 £ 
33 are listed in Table 2. In the column of P es + P er . an entry marked is 
given by the upper bound of (48). 

In Tables 3 to 5, P es + P er and P er are shown for cascaded coding schemes 
in which the inner code is C^i) with 1 £ i £ 13, the outer code is an 
interleaved RS code with a depth of m lf and an erasure-only inner decoding is 
used. Parameters T es and t 2 are chosen to minimize the values of P es + Per ^ or 
a certain bit-error rate e under the restriction that P ep £ 10 -1 ^ for every 
bit-error rate e listed in the Tables. 

In Table 3 the outer code is the NASA standard (255,223) RS code over 

Q 

GF(2°) and the rates are greater than 0.6. For comparison, the case with no 
inner code is shown in the first row. In Table 4 the rates are less than 0.6 
and greater than 0.4, and example schemes with lower rates are given in 
Table 5. 

In Figure 6 (or 7), the curves of P es + P er (or P er ) vs * e are shown f° r 
five representative example schemes listed in Tables 3 to 5. 


6. Conclusion 

In this paper, we have investigated a cascaded coding scheme for error 
control. An important feature of the scheme is that the decoding information 
of the inner code decoder is passed to the outer code decoder. This makes the 
outer code decoding more effective. Error performance of the scheme is 
analyzed. If the inner and outer codes are chosen properly, extremely high 
reliability can be achieved even for a high channel bit-error rate. Many 
example schemes are being evaluated. Some high-rate example schemes are being 
considered by NASA for satellite down-link error control, and some low-rate 
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example schemes are being considered for spacecraft down-link error control. 

A major advantage of the proposed cascaded coding scheme, especially 
with interleaving, is its robustness against unpredictable bursts. 

This paper presents first serious effort in analyzing the error 
performance of a cascaded coding scheme which includes concatenated coding as 
a special case. 
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APPENDIX A 


Proof of Lemma 1 


Let | H | = u. It follows from (7) that 


’1 r l 


( i-l .i 2 » 


k[ } \ ... ± n' [ i z Wj lh g(ii)x jh Y Sh ] 

■*,i m +1 )eI(H) 1 1 ,1 2* ’^ + 1 h«1 j h -0 s h =0 J h’ s h 


.1 


Ti 

•I I W • 

Jm^r 1 s m 1 + 1 = 1 V+l’V+i 


^ +1 ^ +1 ^ m 1 +1 

1 (r,)X 1 Y 1 

1 T| ' ,u 1 _1 


I A (1) 


m.| + 1 


m.| +1 


n i“ Z i h Z i h 

• (1+XY) hm1 (X+Y) h=!l 


= (1+XY)* U Z Aj 1 ^ ... i 

(i 1> i 2 ,-**,i mi+1 )eI(H) 1 1* 1 2» » 1 m 1 +1 

mi+1 mi+1 

n, -X,u- Z i h Z i h 

• (1+XY) h=1 (X+Y) h=1 . ( A— 1 ) 

The set of codewords in Ci whose weight in the h-th i,-bit byte is zero for 
every h in H is a linear (n^ki-iu) subcode of C^. Let C -| ( H ) denote the 
linear (ni-iu,ki-S,u) code obtained from the above subcode by deleting the u 
zero Jl-bit bytes for the u positions in H. Let a[^(H) denote the number of 
codewords of weight i in Then 
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(A-2) 


A.P } (H) = Z aP K ... , 

(i 1 ,i 2 , ••• ,i mi+1 )eI(H;i) 


where 


I ( H ; i ) = { ( i 1 , i 2 , • • • f i mi + i ) : ( i 1 , i 2 > • • • , i m + 1 )eI(H) and 


m 1 +1 

I i h = i } . 
h=1 n 


The right-hand side of (A-1 ) can be rewritten as 


n^Jlu 


(1+XY) lu 'z aP ^HJCI+XY)" 1 lU 1 (X+Y ) 1 . 
i-0 1 


( A— 3 ) 


Let bP \h) be the number of codewords of weight i in the dual code of C.j(H). 
Then, by MacWilliams’ identity [4], (A— 3) can be rewritten as 

-r i On n 1 - *' u /•■> \ n,-£u-i .• n^-iu-i , 

2 HI+XYr 11 Z bP } (H)(1+X) 1 ( 1 -X ) 1 (1 +Y) 1 ( 1 -Y ) 1 . 

i-0 1 


(A-l») 


It follows from (21), (A-1) and (A— 4) that 


>P) 


m 1 r 1 * (ih), Jh 3 h i 

n [ Z Z W, h _U)X h Y h ] 


(i 1 ,i 2 ,---,i mi + 1 )eI(H) 1 1» 1 2* *^+1 h-1 j h «0 3 h «0 J h- 3 h 

r-i r., ^m-i+P Jm,+1 Jm,+1 

• l I 1 W, 1 c (r, )X 1 Y 1 

Jrn^T 1 Jm 1 +1 ’ m 1 +1 


-r, n 1 _iu » n,-S,u-i , n 1 

2 1 Z B 1j (H)(1+X) 1 (1-X) 1 Z Qji.nT-itu.au.XjY 3 . (A-5) 

i-0 s =0 


Taking the terms on both sides of (A-5) for which the degree of Y is t 1 or 
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less and substituting "1" for Y, we have that 


,( 1 ) 

*i *!?»•••. ir 


l 

I 


,1.^1)61(11) ’ i 2 ’ ’ m-j+l j 1 = 0 J Bi -0 J„ i+1 -0 

r m 1 (i h ) , ^m. + l^ 

Z [ n w 1 \(D) • w i 1 (r.) 

(s 1 ,s 2 , • • • ,s m +1 )eS t h=1 J h ,s h J m 1 +1 '^m^l 


-r, n 1 m n.-llu-i . _ 

2 1 I bP'(H)( 1+X) 1 ( 1 -X ) 1 Q. (i.n.-lu.lu.X) . 

i=0 1 C 1 1 


m 1 +1 
Z 

,h=1 


Jh 


( A— 6 ) 


Substituting e/(1-e) for X and multiplying the left-hand side of (A-6) by 

n i 

(1-e) , we obtain the right-hand side of (18). Therefore we have that 


P (1 ) 
r e 


(H) 


-r 

2 


1 


n 1 _J ' U 

Z B^ 1 ) (H)(1-2e) i (1-e) X ' u Q t (i.^-Au.lu.e/Cl-e)) . 
i=0 1 

( A— 7 ) 


Since a generator matrix of the dual code of C.,(H) can be obtained from a 
parity-check matrix of C 1 by deleting all columns corresponding to the h-th 
Jl-bit positions for heH, the following relation holds. 


Bp^H) = Z B ) 1 ; • ... . 

1 I j (H) 1 1» 1 2» » x 


( 1 ) 


(A-8) 


^(H) *1 


where 


I ± (H) - {(i 1 »i 2 >* , *»i n ] 1 +l) : 0 1 £ 1 for 1 1 h 1 m 1 » 

0 <^+1 1 r 1 ’ and h ^ H ^ “ 1 > • 


Then, expression (22) of Lemma 1 follows from (A-7) and (A-8). 
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APPENDIX B 


Proof of Theorem 2 


Let F(X 1 »X 2 f be defined as follows: 


F(X 1 ,Xp, • • • ,X^ + i,Y) - Z ••• Z Z 

1 ii-0 i« =0 i m 


aP ) 


m 1 , l l (i h ) j h s w , 

• n [ Z Z W 1 h .U)X h Y h ] 
h*1 j^-0 s^»0 ^h’ s h 


r., ^m-.+P 

Z 1 W 1 


[ E 1 

V+r 1 ^r 1 Jm i + i ,s mi+i 


(r,)X f 


Jm.+I J 


m^l J m.|+1 


+1 , s m .| +1 1 mi+1 


] . (B-1) 


It follows from (7) and generalized MacWilliams* identity [4 f p.147] that 




F<X.,X,, •••,X- *> ■ X ••• I 

’ ' 1,-0 1^-0 1 

m 1 4-i h iu r r i m 1 +1 

• h “l (1 *V> h <V» h < 1t V* ) ' 


, m i +l 


-r, £, l r 1 

> 1 7 ... 7 7 Bl . 

1 * 1-0 i m -0 iA,-0 1 1' 1 2»** # » 1 m,+1 


,(D 


‘m 1 v 


M 


•[ h ;-(ux h ) t ' 1| ’(i-x h ) Ih ] (ux.^,) 






m. +1 


m.,+1 

n«- Z i 


m.| + 1 

l iv 


111 L l h L l h 

. ( 1 +Y) h” 1 (1 -Y) 11 * 1 


(B-2) 


Let H be a subset of {1,2,*. *, 111 !} and F’ H ,t 1 (X 1' X 2» * * * * x mi + 1 • Y) be the sum of 
the terms of * x 2* * * * ,X m^ +1 ,Y ^ Yor the degree of X^ is nonzero for 

heH and is zero for he{ 1 ,2, • • • ,m 1 }-H, and the degree of Y is t-| or less. 
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Using (10), and (B-2), we have that 


-r, SL 


1 


,0) 


h =0 l l, m ° ^r 0 


*1 


F H,t 1 (X 1 ,X 2'***’ X m 1 +1 ,Y) " 2 

• Cv s< hii 1 »’ n i )YS 1 h y ('*Xh)"" lh <’-x h ) ih - 1 1 


i-u 


r rWi 


i uii T i 

• « } 1 n-x^,) 


m, + 1 


(B-3) 


Let F w,t 1 ( x 1' X 2'-**' X m 1+ 1. Y ) 136 defined as the sum of 

F H,t 1 ^ X 1 ' x 2' * ' * >X m 1 +1 » Y ^ over a11 the subsets, H’s, of {1,2,**‘,m 1 } with 
exactly w elements. Then the second term of (31) is equal to 


- (1-e) 1 F Wft (e/(1-e).e/(1-E),***,e/(l-e),1) . 


(B-H) 


It follows from (B-3), the definition of R w given by (32) and the following 
identity [4, p.153l: 


Z P_(i ,n) = P t (i-1,n-1) , 
s=0 3 L 


(B-5) 


that (B-i<) is equal to 


-r, k.-Jtw l 

-2 1 (1-e) 1 Z ••• 


,0) 


V 0 V° im 1+ l=0 *1 ’ *2’ * ’ ’ ’ ^ + 1 

m^ +1 

* P t 1 ( h =i i h" 1 ' n l' 1)R w (i 1* i 2'* , ‘* i m 1 ;e) • 


HI -l 

(1-2e) 1 


m, +1 
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APPENDIX C 


Derivation of (46) 


Let F (J (X 1 ,X 2 , • * • f X m ^ + 1 , Y) be the sum of terms of F(X^ ,X 2 . • • • ,X m +1 ,Y) 
defined in Appendix B for which the degree of X u is nonzero and the degree of 
Y is t 1 or less. Using (10) and (B-2), we have that 


F U (X,X,«< 


»X, Y) 


,( 1 ) 


-r, l S, r 1 

2 1 E ••• X E B i i ... i 

‘l-O X ' 0 V° 1 2 ' 


t-j n^+1 


t-i h ih 

b n . X ) h 


• [ E P_( E i h ,n, )Y S ] n (1+X) h (1 

s*0 s h-1 n 1 ICKm-, 

h*u 

2,-i„ i„ r 1 -i m 1 + 1 i m 1 +1 

• [(1+X) U (1-X) u - 1] (1+X) 1 (1-X) 1 . 


(C-1) 


The second term of (45) is equal to 

- (1-e)" 1 F u (e/(1-e),e/(1-e),*--,e/(1-e),1) . 
Then (46) follows from (B-5). 
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APPENDIX D 


A formula for computing P 


e,a 1 , ap , • • • , a n 


Let H be a subset of {1, 2, •••, m^}. For small m 1 , say less than 11, 
{ P e ( H ) : HE{1, 2, •••, m 1 } } can be found as shown in section 2.1. Then it 
follows from the principle of inclusion and exclusion [10] that 


e,a 1 ,a 2 ,-..,a mi s „ 0 


= (-1 ) I W i -S _Z P a (H) 


H | -s 


where W * { i | a^^ * 1, 1 £ i £ m 1 } and H - {1, 2, •••, m 1 }-H. 



APPENDIX E 


A procedure for computing p e (u,ot) 

For M u < m-j, 0 £ i <_ n^-S, and a e GF(2^), let Aj^(u,a) (or 
B^\u,a)) be the number of codewords in (or the dual code of C-, ) whose u- 
th symbol is a and whose binary weight excluding the u-th symbol is i. Let ot f 
be the f-th bit of the binary representation of a, and let |ot| be the weight 
of the binary reprensentation of a. It follows from the definition of p e (u,a) 
that 


P e (u,ot) 


n.,-£ n.,-2, 2, 

E aP^u.o) E Z 
i-0 1 j-0 j’=0 


1 

E 

s-0 


t^“S 

E 

s'-O 


wj^(n r lO W j!“i!(4) 


n-i-s-s* 
e s 3 ( 1 -e ) 1 


(E-1) 


For relatively small k^, say less than 25, {A^(u,a)| 0 <_i <_n^-2.} for an 

k 

a in GF(2®') can be found by generating 2 1 codewords of C 1 . 

A procedure for computing p e (u,a) which is more convenient for k.j > n-j- 
k^ will be derived below. By the generalized MacWilliams' identity CM, 
p.lM7], we have that 


^ 1} (u,a) * 2 (ni k]) E £ .bJ 15 


£ 5 Bi' ; (u,B)P 1 (h,n 1 -Jl) n P_ (B f ,1) . 

h-0 BeGF(2*) n 1 1 f-1 a f 1 

(E-2) 


By [M,p.151], we have that 


£ £ a f Bf 

n P a (B f ,1 ) - (-1) f 1 
f-1 a f 1 


(- 1 ) 


( | a| + | B | - | o+B | )/2 


(E-3) 


and 
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-l 


n 1 -£-i 


. -Jl-h 


Z P 1 (h,n 1 -£)(1+XY)" 1 (X+Y) 1 = (1+X)" 1 * “(1-X) h ( 1 +Y) 1 ( 1 — Y ) h 


i=0 


(E-4) 


It follows from (7), (E-2), (E-3) and (E-4) that 


n 1 n-i x n* x n n / i i \ 

Z Ap^u.a) [ E Z wj^Cn,-*) xJy s ] [ Z Z W *,(£) X^ ? Y S ' ] 
i=0 1 j-0 3-0 J,s 1 J'-O s*-0 3 ,s 


n-i-S, n.,-S. 


-(m-k,) 4- a a n 1 Z rn 

2 1 1 (1+XY) 1 ‘(X+Y) 1 1 Z Z t By,' ' (u,B) 

h-0 BeGF(2 4 ) n 


, ( |a| + 1 8 1 - 1 a+B I )/2 , n,-£-h h n.-i-h h 

• (-D 1 (1+X) 1 (1-X) h (1+Y) 1 (1-Y) h 


-(n.| -k 1 ) n 1 -2, /.x 

2 1 E n Bi^u.B) 

h-0 BeGF(2 x ') n 


, ( a + 6 - a+B )/2 n..-4-h h n 1 

• (-D (1+X) 1 (1-X) h E Q’di.n.-i, | a j ,£,X) Y s , 

s-0 3 1 11 


(E-5) 


where 


( 1 +XY) m h (X+Y) h (1+Y) n " i (1-Y) i - Z Q'(i,n,h,m,X)Y s , 

s-0 3 

Q' (i,n,h,m,X) - Z P._ f (i,n) E wS h i(m)X J . 

3 f-0 3 1 j-0 J* 1 

Taking the term on both sides of (E-5) for which the degree of Y is ti or 

less substituting e/(1-e) for X and 1 for Y and multiplying the both sides by 
n l 

(1-e) , we obtain the following formula from (E-1): 


- 37 - 



If C 1 is a shortened cyclic code, min{ 2,,n 1 -k 1 } columns of a generating 

matrix corresponding to the u-th symbol position are linearly independent, 

and for a symbol 8, | 0 <_h<_ n^Jl} can be found by generating 

min{n 1 -k 1 -Sl,0} 

2 codewords of the dual code of 
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Appendix F 


I Derivation of (52) 

i 

At first an upper bound on P ep (u) will be derived. Let us number the 
| segment in a decoded segment-array (Fig. 5) from 1 to n 2 . Suppose that the 

number of erased segments after the inner code decoding is T or less. Let 
E s be the set of the erased segment numbers. For f i E s , let e f be the error 
symbol at the u-th symbol position of the f-th decoded segment, and let i = 
(e.,, e 2 , •••, e n ^). Note that e f is the symbol error at the f-th symbol 
position of the u-th section of a decoded segment-array. Suppose that the u- 

th section of a segment-array is decoded incorrectly by the outer code 

1 - _ 
decoder. Then the u-th section is decoded into an outer codeword v Q + v, 

where v c is the actual transmitted outer codeword and v is the nonzero outer 

codeword induced by the outer code decoding. Let v ^ be the f-th symbol of v. 

Define the following sets associated to v and e. 

i 

W(v) - { f | v f * 0, f t E s }, (F-1 ) 

(F-2) 
(F-3) 

When a section is decoded based on the outer code C 2 , only t 2 or fewer 
symbol errors and T es or fewer erasures are corrected. Hence, the following 
inequality holds: 

|H(e,v)| + | W(v) | - | J(e,v) | _< t 2 . (F-4) 


H(5, v) 2 { f | e f * 0, v f - 0, f i E s }, 

and 

J(i,v) - { f | e f - v f • 0, f i E s }. 
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For given 1 <_ u <_ m., , E g c { 1,2, •••, n 2 ) , v e C 2 , H5{ 1,2, •••, n 2 J 
and J c { i,2, • • • , n 2 J such that H is disjoint from E s and W(v), J w(v) and 
| H | + |w(v)| - [ J | <_ t 2 , let P e (u,E s ,v,H, J) be the probability of the 
occurrence of an error pattern e induced by the inner code decoding for 
which H(e,v)=H and J(5,v)=J. Then 

P e (u,E s ,v,H, J) - [P gg ^ 3 1 [ P e ( u) ] h Cp e ( u , 0 ) ] 2 

• n p (u,v f ) n (1 _P es )_ P e (u,v f )), (F-5) 

feJ e 1 feW( v)-J es e 1 

where i=|E s |, w=|W(v)| and h= | H | (see Figure 8). 

Let W be a subset of { 1 ,2, • • • ,n 2 } -E S ~H such that W2 J, d 2 ~i £ |W| and 
|w|+h-j <_ t 2 . Let C 2 (E 3 ,W) be defined as the following subset of codewords 
in C 2 : 

C 2 (E S ,W) » ( (v 1t v 2 , •••, v^) e C 2 | 

v f #0 if f e W and only if f e WUEg}. (F-6) 
For v e C 2 (E ,W), W(v) - W. Let w denote |W|. Next we estimate 


_Z 

veC 2 (E 3 ,W) 


P e (u,E s 


v,H, J) . 


Since i _< T es and t 2 _< (d 2 ~1 -T es )/2, we have that 


d 2 >_ i + 2t 2 + 1 . 


(F-7) 
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Since d 2 <_ w+i and h+w-j _< t 2 , it follows from (F-7) that 

j _> i + w-d 2 >_ 0 . ( F— 8 ) 

Let J' be a subset of J such that 

| J’ j - i + w - d 2 . ( F— 9 ) 

For any a f e GF(2 i )-{0} with f e J’, consider two different codewords v 
= ( v i» v 2 , •••, v n ^) and v* = (vj, v£, •••, VjJ ) in C 2 (E g ,W) such that = 
= a f for f e J'. Since the weight of v-v’ is at least d 2> we have that 

v f * » for f e EgU W - J'. (F-10) 

It follows from a well known Inequality and (F-10) that 


E n p e (u,v f ) 

ve{veC 2 (E s ,W) |v f *a^ for feJ'} f ' e<J 


= f n T , p e (u » a f ) E n ,P e (u » v f ) 

feJ ve{veC 2 (E s ,W)|v f =a f for feJ»} feJ_J ' 

<. H t p e (u,a f ) E 

f£j ' ve{v£C 2 (E s> W) |v f =a f for feJ*} 

j+dp-i-w 

I Cp e (u,v f )] 2 /(j+dp-i-w) 

feJ-J' e 1 2 


2 x -2 j+dp-i-w 

< n p e (u,a f ) E [p (u,Y q )] 2 

- f £ J * e r q=0 e 


(F-11 ) 
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It follows from (51) and (F-11) that 


_ E 

veC 2 (E s ,W) 


n p (u,v f ) 
feJ e 1 


1 £p e (u) J 


i+w-d 2 2 % -2 


l [p e (u, ] 
q=0 e 


j+d ? -i-w 


Thus it follows from (53) that 


_ I P e (u, E g ,v,H, J) < P(u,i,w,h,j) 

veC 2 (E s ,W) e 3 


Since P er (u) is the sum of _ E P 0 (u,E_ ,v,H, J) taken over all 
er veC 2 (E s ,W) e 3 

•E s , W, H and J, we have that 



T 


es 


(u) < E 
“ i-0 




i 

-i 


,n 2 -l 
V w > 


min{t 2 »n 2 -i-w} 

h-0 


,n 2 “i _ w 
I h 


w 

E 

j-w+h 


«)p(u. 

-to J 


i.w.h.j). 


P er is bounded above by the expression obtained from the right-hand 

m 1 

(F-1i») by replacing F(u,i,w,h,j) with E P(u, i,w,h, j). 

u-1 


(F-12) 

(F-13) 

possible 

( F— 1 4) 
side of 
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Figure 2 Encoding Operation 
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Figure 4 An interleaved code block 
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segment 


k 2 ~th Decoded 
segment 


n 2 ~th Decoded 
segment 


Figure 5 A decoded segment-array 


BIT ERROR RATE £ 


Figure 6 


The sum of probabilities of a block erasure and 
a decoding error. 



UPPER BOUNDS ON THE PROBABILITY OF DECODING ERROR P 



Figure 7 Upper bounds on the probability .. of decoding error 
for cascaded codes. 



Figure 8 Illustration for Equation (F-5) 



Table 1 Inner Codes 




Inner codes (n 1 ,k 1 ) of the l 
' inner code 


SinSlode «S.M) 0.873 8 


Cl <2> SSiode (58.“8) 0.857 8 


C,<3> Single <30.2") 0-800 8 


C-| (4) Sh0r BCH e code < 61 0.787 8 


m-j d 1 t-j Generator polynomial 


1 (l+XH^X) 


1 (1+XK1+X+X 7 ) 


1 (1+X)(1+X 2 +X 5 ) 


6 6 2 (1+X)^(X)* 3 (X) 


C,(5) shor ^Bi 0 de <53.-0) 0.755 8 


5 6 2 (1+X)«fr 1 (X)^ 3 (X) 


C-j (6) 


shortened 


code (59,40) 0.678 8583 (1 +X)^ (X)* 3 (X)* 5 (X) 


0^7) Goppa code (64,40) 0.625 8 


C,(8) eXte BCH d code (32,16) 0.500 8 


r / q \ extended 

Golay code 


(24,12) 0.500 


C 1 ( 1 0) biorthogonal ( 8, 4) 0.500 


shortened 
C, (11 ) Type 0 

l htt ^ 


DTI code 


0,(12) biorthog °Sde ( 16 * 5) 


C n (1 3) biorthog ?Sde (32 » 6) °* 188 



(1+X)^(X)* 3 (X)* 5 (X) 
•$Y ( X ) 4*2 1 (^ 



The generator polynomials are given only for shortened cyclic codes, and 
<J>^(X) is the minimum polynomial of a 1 with a as a root of 1+X+X 6 . 














































Table 2 Probabilities of Decoding Failure or Decoding Error 

and Upper Bounds on the Probability of Decoding Error 
For Cascaded Codes with High Rates 
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Table 3 Probabilities of Decoding Failure or Decoding Error 
and UDDer Bounds on the Probability of Decoding Error 
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Table 5 Probabilities of Decoding Failure or Decoding Error 
and Upper Bounds on the Probability of Decoding Error 























































